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STATINTL 


Central Intelligence Agency 
Headquarters Building, Room 2E23 
Washington, D.C. 20505 


STATIN T | 


In her phone conversation with you today, Miss Walkowicz summarized 
briefly one of the NBS/ACM/NSF "Conferences," or cooperative ventures 
which have been continuing over the past several years. This one has 
to do with job descriptions for computer-related occupations. A 
summary report of that meeting is enclosed, together with a list of 
participants. 


As so many worthwhile endeavors, this project has continued to operate 
on the proverbial shoestring, with participants contributing their 
time and effort. The Action Plan that was developed at the Planning 
Workshop meeting is being implemented slowly. The Workshop participants 
decided to use a technique developed by one of the participants, 

Dr, Raymond Berger, for the description of three computer-related 
occupations: programmer, systems analyst, and computer operator. The 
technique consists of identifying descriptors of tasks and associated 
skills relevant to each occupation. This collection of descriptors, 
then, can be combined and assembled to fit the requirements of indi- 
vidual jobs in the relevant occupation category. 


The programmer job has been completed. However, the systems analyst 
job is in need of $25,000 in order to bring it to completion. The 
enclosed Proposal gives a more detailed description of progress to 
date, and plans for completion of this phase of the effort. 


The total cost of the project is estimated at $25,000. AFIPS will 
provide $10,000, NBS will provide the technical support required, and 
we are looking to other agencies to supply the remaining $15,000. 

The monies would be pooled and forwarded to AFIPS for completion 

of the project. 


I would appreciate your consideration of this request, and will be glad 
to supply any additional information you may require. I may be reached 
on (301) 921-3531. 


Sincerely,:: 
Js i: 
ee 9 
S. Jefferys Chief 
Systems and Software Division 
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CONFERENCE ON COMPUTER-RELATED PERSONNEL 


Twelve invitees to the Planning Workshop for the above Conference 
met at NBS on April 16 and 17, 1974, to study how best to achieve its 
objectives, The principal of the assigned objectives was the identi- 
fication of basic computer-related occupation categories and the 
definition of each in terms of job titles, work content, responsibilities 
and skill requirements. Once this basic structure was defined, a frame~ 
work would be provided for other needs such as the identification of 
criteria for development and evaluation of educational and training 
facilities, for correlation of these facilities with changing skill 
requirements, identification of emerging changes or new occupations 
within the basic structure, and identification_of forecasting 
capabilities and requirements. 


After considerable and vigorous discussion of these objectives, 
the Planning Workshop decided that the primitives of concern were jobs 
and skills, that a set of definitions could be developed, based on an 
initial core of skill descriptors which could be correlated with actual 
jobs. A certain set of such descriptors common to actual jobs in many 
organizations could then be used as standard descriptions for these 
jobs. The Planning Workshop then established three Task Groups each 
of which was assigned responsibility for developing a set of descriptors/ 
skills for describing one of the three occupations to which the members 
decided to devote first attention: programmers, systems analysts, and 
computer operators. Chairmen were appointed and tentative meeting dates 
were set. The Task Groups for programmers and operators will meet 
concurrently in late May or early June; the Task Group for Systems 
Analysts is tentatively planning to meet in September 1974. The Groups 
will meet at locations that will minimize travel for participants. 

Mr. J. David Benenati of The Bendix Corporation, Southfield, Michigan, 
agreed to serve as Chairman of the Task Group for Operators; and 

Dr. Raymond Berger, President of Psychometrics, Inc., Los Angeles, 
will be Chairman of the other two Task Groups. 


The Task Group meetings comprise Step I of the Action Plan developed 
for achieving Conference objectives. Three other Steps complete the 
Plan: 


Step II - Disseminate material developed by the Task Groups 
for critique and assessment of impact 

Step III - Reconvene Planning Workshop for review of results 
of Steps I and Ii 

Step IV - Decide on Follow #7tion Plan 


Activity under Step I is pz -eding slowly. To date, the programmer 
occupation was completed; the jol «izscriptors developed are presented in an 
AFIPS Report entitled, "Computer Programmer Job Analysis. Reference Text," 
by Raymond M. Berger. Analysis of the systems analyst occupation is 
nearing completion. The Task Group on Computer Operators met once and 
developed a plan for proceeding with their assignment. However, because 
of budgetary and other constraints, considerable additional effort is 
still required on this occupation. 
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Conference on Computer-Related Personnel 


My. J. David Benenati 
The Bendix Corporation 
Bendix Center 


Southfield, Michigan 48076 
(313) 352-5000, ext. 5293 
Mr. Robert W. Benton 


Assistant Director 

Financial & General Management 
Studies Division 

General Accounting Office 


Room 6335, 441 G6 St., N.W. 
Washington, D. C. 20548 
.€202) 376-5368 
& 
Dr. Raymond M. Berger** 
President i 
Psychometrics, Inc. 
10889 Wilshire Bivd., Suite 909 
Los Angeles, Calif. 90024 
(213) 477-4249 
% 
Mr. Walter M. Carlson 
IBM Corporation 
Armonk, N. Y. 10504 
(914%) 765-4240 
Mr. William R,. Collins 


Chief,~Management and Social 
Science Occupations Section 
Standards Division, Bureau of 
Policy and Standards 
U.S. Civil Service Commission 
Washington, D. C. 20415 
(202) 632-5631 
Mr. Frank DeVolder 
Acting Regional Commissioner, ADTS 
General Services Administration 
7th and D Sts., S. W. 
Washington, D. C. 20407 
(202) 963-6138 


Dr. Paul S. Herwitz 
IBM Corporation 
Bldg. 706, Dept. D59 
Poughkeepsie, N. Y. 
(914) 463-2191 


12602° 


Mr. Seymour Jeffery 
Chief, Systems & Software Division 
Inst. for Computer Sciences 
and Technology 
National eae of Standards 


ashington ‘Com 20234 
Peep gs ee as 8h 


April 16- 


Z Systems 


17, 1974 


Myr, Edward 0. Lineback , 

Managor, Program Planning 
and Control 

Boeing Computer Services 

Box 24346 

Seattle, Wash. 

(206) 773-1507 


98124 


Mr. Paul D. Oyer 

Computer Systems Directorate 
U.S. Bureau of Census 
Washington, D. C, 20233 
(202) 763-2698 


Mr. Paul M. Pair 

Senior Staff Consultant 
Education Division 
Control Data Corporation 
430 N. Michigan Ave. 
Chicago, Ill. 60611 
(312) 329-0100 


Dr. Robert W. 
AFIPS 

210 Summit Ave, 
Montvale, N. J. 
(201) 391-9810 


Rector 
07645 


Mr. Joseph Rooney 

Office of Manpower Structure 
and Trends 

Bureau of Labor Se atiakeie 

Washington, D. C. 20212 

(202) 9361-2541 


Mr. Gilbert Saunders 
College of the Redwoods 
Eureka, Calif. 95501 
(707) 443-8411 


Mr. Norman Seltzer 

Division of Science Resource 
Studies 

National Science Rousdachon 

Washington, D. C. 20550 

(202) 282-7720 


Walkowicz 

& Software Division 

Inst. for Computer Sciences 
and Technology 

National Bureau of Standards 

Washington, D. C. 20234 

(301) 921-3485 


“ Miss Josephine L. 
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Chairman 


oubmitted by: Dr. Raymond M. HKerger 
Psychometrics, Inc. 
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Proposal 


SYSTEMS ANALYST JOB DESCRIPTION PROJECT: 
SURVEY OF NATIONAL SAMPLE 


Introduction 


This proposal concerns the completion of the Systems Analyst 
Job Description Project. Attachment A is an outline of the 
working model of the project as approved by the AFIPS Exe- 
cutive Board. This model follows the procedure used success- 
fully in the AFIPS Corputer Programmer Job Description. 

Much of the work accomplished to date has been facilitated 

by the cooperative effort of an NBS review committee. Tasks 
4 and 5 in Attachment A are the focus of this proposal. 


The proposal is divided into two sections: Work Accom- 
plished, Work in Progress, and Plans for Completion (the 
national survey of systems analysts). A cost estimate is 
attached. i 


Work Accomplished 


Two major tasks were undertaken in the preliminary phases 
of this project. The first was to develop a taxonomy for 
the categorization of systems analysis (SA) tasks and 
skills, and the second was to develop a general list of SA 
task and skill statements and an appropriate Background 
Data Form. : : 


As part of the effort to accomplish these goals, meetings 
were held with a California review committee in Los Angeles 
and with the National Bureau of Standards SA Job Descrip- 
tion Committee in Washington, D.C. In attempting to re- 
solve the differing philosophies and approaches on the SA 
job structure, the taxonomy underwent continuous modifica- 
tion. A “life-cycle” taxonomy received general favor, but 
in applying this kind of categorization it was found by 

the NBS committee that the life-cycle structure did not al- 
ways fit the various tasks and skills. 


A second problem became apparent with the list of general 
SA tasks that had been developed. Systems analysts who 
were business applications oriented, found (in a pilot study) 
that much of the task list was more applicable to scienti-~ 
fic or military systems than to their particular systems 
area. 
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As a result of these difficulties with taxonomy and task 
orientation, it was decided that a second list should be 
developed for systems analysts in business applications, 
and that the life cycle approach would influence but not 
xigidly prescribe the categorizing of the tasks. 


The principal effort in recent months was the generation of 
a business applications SA task list. To avoid the scien-~ 
tific and military systems bias of the first list, it was 
decided to start from scratch in developing the new list. 
The sequence of work events below resulted in a list of 
such merit that the original scientific list was revised 
along the same lines. 


(1) A review was made of the literature dealing with 
the business SA job and a preliminary list of 
task statements was derived. 


(2) A committee was formed with Harold Ellis of the 
L.A. DWP and UCLA, Douglas Meecham of Hughes, Dr. 
Norman Willmorth of SDC, and Dr. Ray Berger. Six 
day-long working sessions and several night ses~ 
sions were heid from March to just prior to the 
NCC meetings in May. Using the preliminary list 
as a starting point, the comaittee restructured 
the taxonomy into a modified life cycle and pro- 
duced extensive revisions and additions to the 
task list. . 


(3) The skills list developed in the previous phase 
of the project was reviewed by the above commit- 
tee to see if it could remain applicable as a 
common list to all the systems analysis applica- 
tions (scientific, military systems, business, or 
other). It was decided to retain the single 
skills list but to amplify and restructure it. 
This work was accomplished subsequently by Will- 
morth and Berger, and the resulting list was re- 
viewed by Elizabeth Alexander of Con Ed in New 
York, an NBS committee member. Ms. Alexander 
made some useful suggestions that went into a 
further revision. 


(4) The list of scientific/engineering/military SA 
tasks was restructured and augmented to make it 
consistent with the form and content of the bu- 
siness applications list. 
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Work in Progress 
Jhe work in progress is concerned primarily with the Deiphi 
or expert opinion phase of the project. At the May 1975 
NCC, systems analysts were asked to participate in the 
evaluation of the SA task and skill lists. The greater 
proportion of voluntcers were involved in the business ap- 
plications area, but there were sufficient numbers of re- 
spondents to conduct Delphi evaluations for both task 
lists, especially when augmented with people recommended 
by the NBS committee. 


In allowing for vacation schedules it was decided not to 
try to conduct the Delphi during the summer. Efforts in 
July and August included further refinement of the Scien- 
tific/Engineering/Military SA list, and a meeting with some 
of the NBS committee on July 15. Josephine Walkowicz of 
NBS, Nancy Ayer of the Dept. of Agriculture, Paul Oyer of 
the U.S. Census Bureau, and Ray Berger met in Washington, 
D.C., to review the SA task and skill lists. The reviews 
resulted in some further editing. Additional Delphi parti- 
cipants were recommended by the committee. 


A “mini-Delphi" was held in Los Angeles with three scienti- 
fic/military and three business SA experts to discover 
problems that might arise {with respect to wording, redun- 
dancy, etc.) in the national Delphi effort. The results of 
the mini-Delphi have been incorporated into a major editing 
effort of the lists just prior to conducting the national 
Delphi evaluation. 


The edited lists are to be mailed to the Delphi partici- 
pants shortly. The returned evaluations will be tabulated 
and the results mailed to the participants along with in- 
structions for making second iteration evaluations. The 
results of the second iteration will be tabulated and ana- 
lyzed. Tasks and skills receiving moderate to high impor- 
tance ratings will constitute the "Ideal" Systems Analyst 
Job Descriptions in the scientific and business areas. 


Proposed Plans for Completion of the 


National Survey of Systems Analysts 


It is planned to submit essentially the same lists used in 
the Delphi phase to a representative national sample of 
systems analysts. The importance of a field survey is to 
establish what a systems analyst does on the job (as Op7 
posed to what the Delphi experts believe he should do, 
ideally). The AFIPS Computer Prograrmer Job Analysis de~ 
monstrated the utility of the national survey. 
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The steps in conducting the survey will be: (Steps 1, 2 
and 3 are parallel activities in terms of time.) 


(2) 


(2) 


(3) - 


Revision of SA Job Description Lists. The results 
of the Delphi evaluation will be used to revise 
specific items of the task and skills lists. It 

is planned that few substantive changes in the 

item content will be made so that Survey and Delphi 
results may be directiy compared. Generally, these 
changes will entail clarification of terms and ad- 
dition of examples to individual items. Complex 
items may be broken up in cases where some SA's re- 
spond positively to one feature of a task defini- 
tion, and ethers respond negatively to another fea- 
ture. 


The Delphi participants will be asked to recommend 
other tasks and skills that should be on the lists. 
These will be added to the Survey lists if general- 
ly deemed important. 


Preparation of the Survey Booklets. The tasks and 
Skills Lists will be compiled in booklet form with 
complete instructions for rating the items. A 
mark sense sheet will accompany each booklet so 
that the responses can be processed for computer 
analysis easily and economically. 


Two Survey booklet forms will be prepared: one for 
the business applications SA, and the other for the 
scientific/engineering and military systems SA. 


Selection of National Sample of SA's. The SA's 
Will be sampled by using the stratified-random me- 
thod. This will be done in two steps: 


(a) Organizations with data-processing facili- 
ties will be randomly sampled within seve~ 
ral strata. The stratification will be in 
terms of organizations of different sizes, 
different applications, and geographic 
areas to assure representativeness. 


(b) A specified proportion of the SA's in each 
organization in the sample will be select-. 
ed. Variables such as amount of experi- 
ence and application area will be factors 
jn the selection. The target sample size 
is 500 to 700 in the two major groups (Bu- 
siness and Scientific/Engineering/Military) - 
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(4) Contacts with Organizations. Contacts will be made 
with organizations through the auspices of AFIPS 
and NBS to enlist cooperation for the Survey. Ano- 
nymity will be assured to organizations and to in- 


dividual participants. 


(5) Analysis and Reports. The analysis and reports 
will follow the modél for the Computer Programmer 
Job Analysis and the final report will be format- 
ted to be in publishable form. A draft of the re- 
port will be prepared for review by appropriate 
committees at NBS and AFIPS prior to final editing. 


Duration of Project 


Sampling, data collection, and analysis of survey results: 
5 months 


Preparation of report: 3 months 


Total estimated duration: 8 months 
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ATTACHMENT A 


OUTLINE OF SYSTEMS ANALYST JOB DESCRIPTION PROJECT 


Task ls 


Ll 


2e2 
Task 3: 


361 


Define the taxonomy and scope of systems analysis 


activities and skills. 


Prepare categorizational framework of systems 


analyst's job. 


Compile relevant tasks and skills for the various 
categories. 


Preliminary review and revision of taxonomy and 
descriptors by systems analyst managers and sen- 
jor systems analysts. 


Establish job activities and skills lists. 
of the preliminary tasks and skills 


panel of individuals ‘actively engaged 
analysis work. 


Assessment 
lists by a 
in systems 


consolidate the systems analysis task 
lists. 


Revise and 
and skills 


Conduct evaluation of job activities and skills 


(Delphi approach). 


Arrange for groups of recommended systems analy~ 
sis experts to participate in the Delphi evalua- 
tion of the job descriptions. 


Conduct Delphi evaluation of job activities and 
skills by panels of business applications and 
scientific/engineering systems analysts. 


Analysis of results and revision of lists for 


survey in Task 4. 


Conduct a survey of a national sample of systems 
analysts. 

Prepare survey booklets with lists of job. acti-= 
vities and skills to be rated. 
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4.2 


Task 5: 


Sample systems analysts by using stratified-random 
method in which organizations with computer faci- 
lities are randomly sampled. , A proportionate num- 
ber of systems analysts from each organization will 
be asked to participate anonymously. Target sam- 
ple size will be 500 to 700 for each of the two 
systems analyst areas. This number will allow re- 
liable segmentation into subgroups of interest. 


Data collection and analysis of survey results. 


Write draft of the project report. 
Review of draft by NBS and AFIPS committees. 
Editing of revised draft. 


Preparation of final report. Camera-ready copy 
will be submitted to NBS and AFIPS for printing. 
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Systems Analyst Job Description Project: 


Survey Phase 
COST ESTIMATE 


Professional and Technical 


Project Director, R.M. Berger, Ph.D. 


46 days @ 200. (includes office facilities, 


equipment, and other overhead items) 


Consultants (systems analysis experts) 
5 days @ 150. 


Research Associate, 50% time for 8 months 
@ 12,000. (annual rate) 


Data Processor, 100 hours @ 10. per hour 
Clerical 
Typist/clerk, 20% time for 8 months 
@ &@,400. (annual rate) 
Employee Benefits 
10% of professional and clerical sakaries 
(non-consultant) 


Computex Time 


Phone 


Long distance calls to participants, etc. 


Supplies and Postage 


Printing 


Survey booklets and Op Scan Sheets (also 


includes miscellaneous Xerox duplication) 


4,000. 


1,000. 


1,320. 


1,452. 


500. 


550. 


700. 


4,500. 
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COST ESTIMATE (Cont'd) 


Travol 


Two trips, L.A. to East, for project conferences $ 988.00 
with NBS/AFIPS committee: 
1, review proposed survey materials 
prior to printing 
2. review draft of final report 


Round trip air coach; ground transportation; 
hotel accomodations 


Total $25,000.00 


Cost to NBS: 15,000.00 
Cost to AFIPS: 10,000.00 
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